Searching PAJ 



1/1 



PATENT ABSTRACTS OF JAPAN 



(1 DPublication number : 2003-163894 
(43)Date of publication of application : 06.06.2003 



(51)IntCI. 


K04N 7/01 




(21)App1ication number : 2002-289037 


(71)Applicant : 


SAMSUNG ELECTRONICS CO LTD 


(22)Date of filing : 01.10.2002 


(72)lnventor : 


LEE SUNG-HEE 






YANG SEUNG-JOON 


<30)Priority 

Priority number : 2001 200166014 Priority date 


25.10.2001 Priority country 


: KR 



(54) APPARATUS AND METHOD OF CONVERTING FRAME AND/OR FIELD RATE USING ADAPTIVE MOTION COMPENSATION 

(57)Abstraot 

PROBLEM TO BE SOLVED: To provide a frame rate converter and its method adopting different 
motion compensation systems on the basis of motion information by blocks. 
SOLUTION: The method of this Invention includes: a step of estimating a motion vector of a 
frame and/or field to be interpolated and the accuracy of the motion vector using motion 
vectors of previous and next frames and/or fields; a step of determining motion information by 
analyzing the estimated motion vector, and calculating a correlation between the motion vector 
of the current block and the motion vectors of neighboring blocks; a step of generating pixels to 
be interpolated by performing motion compensation in a frame and/or field to be interpolated 
using the estimated motion vector and using pixels neighboring a pixel to be interpolated in the 
frame and/or field to be interpolated in the previous and next frame and/or field to be 
interpolated; and a step of outputting the generated pixels as interpolation values according to 
the accuracy of the estimated motion vector the motion information, and the correlation. 
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H#Mh*©8H] 

[SJ#«1] A*$*iSltfe«fI#©U-K£3Eift-r«> 
(b) frEifiH (a) -e«lg**ifcSil!#/<>> Htttttf 

h^tgja^nv^a^^ Mnn©«Hfi£it* 
(o) frffiiSS (a) T?»S**tfeSi#^ H;i>£ffli,* 

( d ) ffira*<i?>7 U-A&tf/Xf*7 * -/b KTJfflH 

■HfcfcJHlvc. ttlffl**V*Ii**4jfc*Si§8i:» 

(e) ItrEjfig (a) -CttJg**l.fcM£«9 h/UffllEitt 
SiSrEiSS (b) -t**«Sfcfea*nMMltflflHar:: 
*U. fllEiSg (c) StfttrEilS (d) T?£fi6<k*ifc 

/xi*7 < -n> K u- K&tfe**. 
US*«2] fiEiga (a) ©at*? h/uronEStfg 

I*?p y*©£r©@Sli©St«JR«Lfc«t£ffll*-Cft* 

*#i*Cfct*«fc-r*IMiai l=Ett©7U-A&tf 

/XI* 7< — A» K U- hftafttt. 
[R*K3] HEiSS (b) ©tt*titf&©*$l*> 
(a - 1) $EiiflT?iiS*;h.fcHl£'<<7 h;KD$Mr£ 

#■ urns©**** p-/<*»#><? h/u^jtsr 
ss^^fc^Pv^o)!!!*^^ h^tnrEiBa (a 

T*H**i*7 P-A&Ut/XI* 7 •<-/!/ KOHMte 

(a-3) glfeD^P-j/?©!!!^*? l-yuifBftLfcU 
K;ui:fl>ll*ffl^T*HttStt»:T*jaStt^ 
t?CiS1#at^«a}««1 l=E$©7 U-A&tf/X 
f*7*-/uKu-- 

tju*« c & tt in *« 3 ices© -? u-as 

* Lrmzziizzt %®mtt s§i*«3 ice®© 7 
u-Ai&tf/Xf*7 KU- hfta»8. 

? h;u©tx h?9Att*g|JM&j£*i-ciift34it 

C <t *8?*li3 l=EK©7 U-ASV/XI* 
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r«> ut*a7] iuESi*isffii»siisi*. 

l> (a-1 ) flJE?D';>*©i!l£'<* h^£?P-/OW» 

h/u *y<h*iMgfc» WE^o^f ©»#i»a*yp-/Ou 
(a-2> nHauMtj:y**it«*. ie^o^io 

»# (a-3) tfrE?p •>$©»£<<$ h/MMfn** hu 

H* -CfctWft. WE7"P?7 ©»#««£-t?P»£& LT 

sjg-f sisfit £ -r *s*«3 ice© 

ffli^ ©7U-ARi^/xi*7*-;uKu-h£&;£au 
Mflt H**«8] fflKifitl (a-3) T?5SS©^P-y^© 
h;i/t^teLfc^p v^rorotK^ hsu©£ffi 
UBS) £tt#*6tt"CV7 hX-f v?>if1Bi: LTfflt>*-t& 
71/ fttat^SfI*a3lcE®©7U-Aatf/XI±7.<- 

rer*«9] wEias (c) owmskntft. 

Eft 1irEara*ilx*7U-x.&w/xii7^-;i»K©Il«*< 
ftfc ^*Jtlfc^P9i7©Slt/<^ h;u£mvcSMSLfc7U 

&tf ^®trS!B*«llcEIS©7l/-Aaot/XI*7^- 

*ft ib*si oi iirEiae (c) ©Hasaaai*. 
its StrEffll3**i«.7 u-A&tf/xi*7 -f-n> vowtttfi 
Rtf #£ftfc:?p??l=Jg1$Lfc:7^y*©iiit'<* h;u£ 
flH>"C. iSSfgLfc7U-A;&tf/XI*7.r-;uK©Iif!t 

tii*tift*«cfc&ttftfc*«it*flii=ett®7u 
flr* -A&tf/xi*7 ^ ->u k u- hSttjja. 

m*sii] mm®® (.a) omm&mt* 
i»e^h*jKS7 u— Aai;/xi*7^— ;u k©bk$ 

K© »eufc7U-jU/7-r-;i/ K©S-*tifil=#tt-rs 

(a mmx'®®?z>z.bmwLb?z>m*mMzm®<>>yis 

6<^ 2] MEiSfl (o) ©E^jjfel*, 

fiSEfflH**l*7 b-A»t;/XI*7<- ;U K©E*«< 
fc© PSS Lfc 7 U-Aat;/XI*7 ^ K©RMt UfcH* 

*ffl^-cttB-r*c:t^«fr*R«ai i=e«©7 

/X b-A&^/XI±7<-^KL'-hffigi73,4. 

31 filEififl (e) ©U^*|*. 
5A iaEffira*4iS7U-Aat;/XI*7^-;l<h*©IIJgi4^ 

y. «&E®e (a) T»itS44ifcjE«ME*»4S.&!llfcB 
IMIJiVmVI*. »E»« (e) T?*»&*vfciFjg* 
tffl *Sra*tlS®^tLTS^L. ®JEM@ (a) 1?f6S* 

©7 *tfeiE«a*t4*6*ifeBi»tt*yft^»* s tammm 
*=ts«$«t-r*K*isiic82i£©7u-Aau:/x 

fc* 1*7 Kb- 
XI* [R*«14] SJEiifi (e) 
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maun * ti* 7 u-asv/xi* 7 -/u vowmtf 

£**Vfc7"P V? ©Bit* -f^D-*^Sj#T«fcih. 

tf. ureas (c) •e^^iifcEimtiirEig^ (d) 
■c*K>e.4ifc@jgt^&» si£©:?n«/>>©i&$><>7 h 

A>£BI&Lfc:?ns/>; ©!&£<<$ b;ui©£fii£fflUfc 

r=IE®©7U-A&o:/xi*7^-;uKu- 
r-£&;*ac. 

(*. 8ifc©7p?7©iag** h;u&BS«Lfc7P5/$ 
**ifc®^fcKlEi®iB (d) -C*fc&tifeM.J:l=. Jl 

[»*« 1 6 ] tUBBS < 8 ) OMtSjftl*, 

#**lfc?a** ©B*** h;i>ilSM8Lfc7P»./*© 

^ — ;u K©HS© * t -r T >tl k &&© 7 L/- Aay/ 

SCfcSfttSfcfStSslUSl l=?B©©7l/-A&tf/X 
l±7-f-;uKU- h«ft*gj. 
[»#S!17] MBiM (c) ©HSt*/*!*, 
flrlEtiH 7 1/- A&tf /XI* 7 < -;u K©II55Sj&< 
S^ih^P-y^SIlt'** h^fc«SL.f=^Pv^«> 
h;WtSfflUT, 6t«iI©7U-A&tf/XI*7 
* -JU PO)®m<DSWafck Jjlfc©7 U-A&tf /Xl*7 

&tf /xi*7 -;u k u- h&jfestfiicfcivc, 
I6i*fl*R£*i£U SI£©7Py7 ©Si*** 

if IHI * ft* 7 /XI* 7 -f -;u KHMfc Lfc 7 

u-Aatf/xte 7 ^ -;u p-eftm * ti&mm t mm l 



»t*ifi?St*^4?7U-A&u:/XI*7>-;i/ 
-r-S£&gfi. 

ilkfcishtzWiZ** k;p©»*$#BSU-c^p-/^H!i 

*;i,£l£j£-rs7 B-A/uW)$m%.®k. 
filial p-/Ousi * ftfc? p -/ <*■ £ 

<«* MuittSSJifca*** h;i,t*JtSLr7'P3' 
7 ©S& £fS*R£*5£-f m £ 9 -f 7"»5t«P <!: » 
Si£©7P? * ©!&#'<$ h;Ufcf»1$Lfc7P»y^©Sl 
h;ut©^*H-SLr. tttttflpra«£*ffl- 

xw-tsmkotiammzmw-tzmmmmiak zatiz 

kZHf&k?Zm*mi 8(=1E®©7U-A&tf/Xli 
7<-/H-*U-r-&&gJi, 

[0001] 

mwomt *«wi*tt«m-i-©7^— 7 
»/Ksea«fiav*©*ai;«y. <&ic7Pf ^siica 

7 u-Aatf/xi*7 ^-;u k u- r-g&gg&u;*© 

[00021 

mmomi -«ai=. 0«'STvs^$K3 7'py5 

AS*8SSft-r*fc»lc|*cti&©lia©7^— -7 ? F-^ 

sra7^;i/it-$sffl^T7#-7?/ h^ms^Lfc 

Z*ia>lt®%mz&t>mVv* (mot Ion 
jitter) ^ttiSW^lCfcMtS^fifW (blur 
ring) SE&fcfcjfc-fS. #(ZHDTV©J:5ICli® 

So ^sssa^Ktjfe-rsfctoi^ sjfidfissttina 

(mo tlon compensation) ^ffil^S 

[0003] 01 l*«t*©K#ffl©S7L/-Agfem*Ji 
**-r«B^0-C-j6S„ 01 *#gB-T*ili. «H**l*7 
U-A 

[»1] 

l*3 -y -7"^ x-f 7>7^>U*-y ^^SffiUt* 1 
©«*: 9 1=368**1.5., 
[»2] 
(Stl) 

r 

F,(x,n --) - MEDIAN(mct,av,mcr) 

[0004] ::t\ S4ftLfc~0(D7U-A (n- 
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[»3] 
(5*2) 

mcl = F(x- oS(x, n), n - 1) 
mcr - F(x-(L- a)D(x, n), n) 

ov-|(F(*,») + F(*,n-l)) 

ZZX\ al*ZO©7U-A©fffl^ai19**l€>'7U-A 
[»4] 

D 

tooos] st 2 tensive t LB£*£ h/utfiEfliic 

jt£$*vfcjS&tf. i#>IIf-5limc I imc r © 
«t**TU *©®*mi*ft$iIi&lIiLTJ*j£;k;K 

C©», Kit** h*«t7EB-Cfeh.tf. ataifi 
5 s — r * l*«JlfcoTas*£*I& L*l^ a v t-* tmm 

aafcaBsaafianwfctt^n v*f y js*(dt? 

[0006] 

iSEU X8H£©?P'yf ©at** bJUtmmya-v 

W©ttl©g WI*SiIE:7 l/-A&tf/Xt*£8Wfa£3Sffl 
S. 

[0007] 

[K®*fi*-f«fc«)©?K] t!TKgtt$^t*fcft 
57I/-AM/Xti7^-^ KU- r-g&7J£l*. 

f SB*** h/ufciE?ifi£if3£f (b)fiir 
IHiBg (a) T?aS;S;h,fcBi*'^ r-^£##rLTB£ 

fflnussttg-f&ifigi. (c) iirE>§*§ (a) uas 
s^ifcut^ Hufcmvcarasfts^u-A&tf/ 

fots&mt. (a) m&i,tz?is-j*X'i$fsizti&® 

«8t, (e) HUEiSg (a) xmSZtitzm** h 
;u©i{tatKrlB®8 (b) Taa£fcfeB#flHMttf 



ffiHSCS^flrtBSfig (c) Atflteaa (d) 

[0008] tne«koBn«s«-r«fe«>i^ scant 

«3e*«fc« tteBtaBweaBdriifeB*** »• 
iP*»«ffca*iiMit**L, sa^p^ae*? 
h*fcaBN**ttft*-«B*#*r*mfc. tutmm 

u-ABtf/Xi*? •< -A- h"CB*a* ta?T*N£ 

U-A&tf/Xf*?-*-/!, KHMftLfc? u-Aatf/ 
Xtt 7 < -;u K -eaiB * t MIR t fcll* t L 

T. am*fc«fla*£*r«tt£imfm*fti:«. WE 
B*»«¥R-C££**ifea*ffittfcttUkl=J:yB* 

a«fflw*satf»ERffli««m¥s-c**aF*ifcffl« 

[0009] 

mmom&ammi bit. »ttLfcEHB$*RLT* 

fP3lc«6»SB£*H§S?7 u- h£ag^£* L 
fc^P.-yf 0T5fc«. B2©3B«a*a«jE7U-AU 

- b&minimmm&z 1 0 a#»«fS2 3 0 
t. a*aflmNtf22ofc. 'j-7a(ae?2 4 0i:. 
»ea*a«fip2 5o&««?. 
[00 1 03 ar* a#as«?2 1 oi*7u-A/7-f 
—a- pbobb** h;u«ffl^raia**i.*7u-A/ 

So wt, ^pv^s»©B#asi*a«i«i=A**<i 

■7 ^ -;U Kt»^P v t ©IK Xfc-^lcS) o 

T#^R f £ ^KUttJ© 7 ^-Vl/ K©-S Ufc 

©i4s^a©^p«yf ©at^-7 h^tLras-r 

So ai8j$4t'57 U — A (interpolated 
f r a me) /7<f — fl»K (interpolated 

field) **.®mmzK-h*ii\&-'DO)?\s-jx/ 

7^-;uK©+ratiS-e#«EL!B:It*i.li*&'S:<, aiSl 
[»5] 

— ♦ 

ft&H3©.«fc5l=B*a«Sff5. *LTa#-<f h;u. 
©iEJIStt^P ©*T©a»©«*R« Lfclii L 
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[00 11] B#»«fi!2 3 0l*. M£Jt£6&2 1 0V 

Stftlc m&o>?n b)\,kmm-7ayV 

shut**** \-)i>0>m®mz&-32iawmzmr 

•5. 

I001 2] Ei*»lt*SraSB2 2 0li, ©#«I^€U2 i 
JSm)Si:L-CK#ffi«ttFBI6P2 2 0l*, ffiia**i£:7U 

A&tf/Xli 7 •<-;!/ K©M3Stf£*;h.fc:7P 
J8Lfc:fP»./*<E>S&£'<* h/l/£ffilvcSM8Lfc7U- 

x>atf/:su* 7 < -;u ran *■ ttttat*. 

[0 0 13] i)-7m^UZ40l^ ®ffii!tlZ>74- 

motto® y < -;u K-e titsi zhzwmtmm Uz®m t 
tmi^x. t&Mztiz>wm*±i&t&, cross, lira* 

(St3) 



JBlCti)#IS(a«tt2 5 01*. Bl#fl5£at2 1 0-C8tj£*;tl 

fc»*flMtttttBBtt=*3#. &tftSffiM«3i!2 2 0 
&tf 'J=7*MI«2 4 0^«**ifcH**«IHfill: L 

[0 0 14] 04l*16#»«fS©gfflia-efc* (> EI4<D 
WlZfttiimt. <fa-/Om$mS. (global m 
ot ion est Imet 1 on) 9>420^1t$ 

fHM" tflHUtt JtS5 4 1 Ofr&tMtfrh.*. 
[001 5] ■4*»M-4ti*. jfn-^MKIfeM 
4 2 0 ItAA^tiSKi*^^ f /l/$fiH*T yp-/<;uss 

*-r. rat** h/t-sAau-cfc^pv? h 
;KDt7.h^A$^«> (isg5i o) . &dt?. tx 

h^At?3E»***gfC (fflg5 2 0) cW?n 
-A/USt*? HUt LTfc£-f* (jig 5 3 0) „ 
[0 0 16] CwTK *¥/Sl*l«0rotX h^A* 

h x . hyt+tus. ira-A)mtow^mt. a 
3, S4©<fcaicsg-rsciA<T»^§. 

[»6] 



global motion 



ion A*" 
[no, 



yes, if I x *Qorl y *0, 

otherwise 



f r =ik\ke[-sr t srlk«O t h K (k)>e p (k)} 
l-sr, srl ^Ml^^ttU */» U) ttttiM (thresh 

V* «arg max /i v (*) 



[»7] 
C&4) 



*#JfcL«a*MlHH<J!>v:7 h**f ^ (soft s w 
itch) t!£LTm>&*l&o BH%. V*7 h*-f 

[ft8] 

(5*6) 



zero, if V « 0, 
ioc«/, otherwise 



soft switch 



[00 1 7] m««Wa«!4 1 01*. ^fiO^Pv^SS 



B6ttasjen««ttt««>ff«iiBi-cfc«. 

[00 1 8] $fc-*\ H»5>-< ?1*$R*<7P-/^U«I#T? 
feifctf. S«8f6 2 0l*S6©,*:5lCll#fflffi*iraSP2 
2 0 7?*jS**tf=liJRffiS'ffiAf'5. 

[»9] 
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(5*6) 
[»10] 

/( > fn-1 j, fn 

[001 9] w>$*<(7tim&-eaWi$T!&Mt. as? 

6J6 2 0I*, S7©*5l='J-rffilHllP2 4 01»±fiE* 

[811] 

(557) 

/,W-|[/^.(x) +/.(*)] 

2 01*. a—hjmtume 1 o-e&j*£*LfcMHI 
£tt*rfS. P-*^BitM«ep6 1 Ol*. ffiBaitkl= 
a^5£B#*i&ttII*Pmc (x) tU-T«iaiS^P 

avg (x) ko>&m$mr&. <fcy§f l<ssw?*i 

■J=-rffip B lfflSi«*A*Lt, as, S9, aiosi 
cxmmmwmmpmc (x) ty-r«iiwii*fltp 

{sSl 0) 

Pmc (x)~MEDIAW^ 
Pavg (x)=MEDLU{f, 



avg (x) i£#«>fc&< ^i«X&iI*ffi$fflU-C. * 
1 1«)J:5l=a«66«)l=tSra®f i (x) ££fe£f$. 
[»12] 

C*8> 

/■(*)- /U(*+v;)> 

[0 0 2 0] CCTV h^V i l*@7©«fc5IC 

-AkTm&tomzmMti&mm-kv hzmatL. «■ 

[&1 3] 

Cs5fl) 

[002 1] CCD* t< 7" Mill*. 8H£C0:7Pv7C9It& 
X (smo o t h n e 6 s) ttomift&Z <k*<T?£?>. 

xA-Xfc&SfcS^Lfci&t** h/utt. p-*;ub 

t©V7h^»;f^ (soft switch In 
[»14] 



^(/^(*)+/«(*))/2}, 



[0 0 2 2] uCU, ®4©m8J£tt#eM 1 o-e##> 
fcV7hX*V?©fctf>©1SB§{tkl** P mc iP 

SS?*HfcgSI«r B 1HSil*. &1 i £LT5&B*4v&. 
[SSM 5] 

(ill) 

X. 8iRSS6 2 oli, 2 i o-cmfettitc* 

®sttt£*jef t,La#^'f^A<yp-/<;u8i)#^ 

LT*lSgi*4i.;h,|*\ »tffi«K<fc5t$rate)b<tB***u 
iltS"f ^P-73/H6t-efc*S^. 07(0*51=* 
S®#tftEi|i (multiple motion tra 

j e c t o r i e s) ?P V?T—T-< 77 $ 



•5. gujft;t;W*\ ft # * -f P - A;m * fc L T 
tt<fcy*#l^«^ ?p-/<;u«i#I*p-:*j;H!)£*«1' 
[0023] 

[SSE©^] IJilL.fcJ: ; 5l=. *%mz&Z>k. 7a 

©Sit"** hrt.fc©*g|l1t£ffi^t'V7 hX-f 
ffT?-tl=J:y. 7"B«;^7-f^777h*a&t 

ffii,x«ctic*y. Sd^^f h/ncfcf-fsxA-x^x 
[0®©1®ijifcISiSS] 

[@i] ft*©ili£ffite£ffii^=7U-Au-hg?& 

7j&**?-8t£;E!T?fc5„ 
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2] *S§BJH=fi&SiS6»SffiffiM7U-AU-h 

■ 3] 02<&S!lt»E©T?ll5t*ftfcl&£** h/U 

E4] @3<DSi£#tfSi<DSMi@-cfe£. 

05] ®4«)^a-y<;Hi^SSB©ifSa0-cfc 

o 

06] a&n$ttftffi0ftM2i-T!fcs. 

07] 0 6 fl> P #«^S-C^ft0 ? a y * 



2 1 0« 
220- 
230- 
240- 
250- 



[01] 



[02] 



[03] 



n-1 
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BftttS* 
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[BHJ 
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^420 







^430 



[06] 



[05] 
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